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DYNAMIC DELAY COMPENSATION FOR PACKET— BASED VOICE NETWORK 

FIELD OF THE INVENTION 

The present invention, relates in general to digital 
communication networks, and is particularly directed to a 
new and improved mechanism for compensating for variable 
transport delay encountered in a packet-based digital voice 
network, by dynamically updating, as necessary, the value 
of buffer delay injected at a receive decoder end of the 
network, so as to maintain the buffer delay at a value 
associated with the maximum value of transport delay that 
has been encountered in the course of a call. 

BACKGROUND OF THE INVENTION 

Digital voice networks are generally comprised of two 
principal building blocks - an encoder and a decoder - that 
are customarily implemented in a single piece of 
encode/decode hardware known as a CODEC. As 
diagrammatically shown in Figure 1, respective CODECS 1 and 
2 are installed at opposite ends of a communication channel 
3, that provides digital transport capability between 
equipments at respective 'west 1 and 1 east 1 sites 4 and 5 of 
the network. The respective encoder portions IE and 2E of 
CODECs 1 and 2 sample analog voice signals supplied thereto 
at a prescribed sampling frequency and convert the samples 




into a digital representation suitable for transport over 
the channel 3 . The sampling rate of an analog voice signal 
in conjunction with the amount of data per sample 
determines the required bandwidth for the channel. 
5 In a typical network, each voice channel is assigned 

to a dedicated time-slot of a time division multiplexed 
(TDM) network. Because each voice channel has a dedicated 
time slot, data arrives at the decoder portion of the CODEC 
in a very constant and predictable manner. This is 

1^ diagrammatically illustrated in the timing diagram 20 of 

□ 

B Figure 2, where successive TDM data packets 21-25 are shown 

as being equally spaced apart by respective spacings a in 
successive ones of an arbitrary sequence of packet 
intervals 11-15 within a voice channel of interest, so as 
to enable the CODEC to convert the data back into an analog 
RJ voice signal. 

£3 A shortcoming of such a TDM voice network is that when 

no voice call is being made, the dedicated bandwidth for 
that voice channel is wasted. To overcome this wasted 

20 bandwidth problem, statistically based packet switching 

networks have been developed, in which bandwidth is 
statistically multiplexed on an as-needed basis. In such a 
packet switched network, the available bandwidth may be 
considered to be a single large "pipe" into which packets 

25 of data are inserted. 
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As shown diagrammatic ally in Figure 3, digitized data 
(voice or otherwise) to be transported is segmented into 
small segments or packets 40, which are placed into a queue 
42 and then transmitted, in the order in which they are 
placed into the queue, by a transceiver 44 over the digital 
communication channel 46 to a CODEC 50 at the far end of 
the channel. Each packet of data occupies the entire 
bandwidth for a small period of time. 

Now although packet-based networks overcome the wasted 
bandwidth problem, they also introduce a variable amount of 
delay into the network. Namely, because packets do not have 
a dedicated time-slot, their arrival at the receive or far 
end of the network will depend upon on how much data has 
been queued up in front of them. While this variable delay 
may not be of particular concern for data-only 
applications, it can become quite noticeable in voice 
applications. This problem is illustrated diagrammatically 
in the above-referenced timing signal diagram 30 of Figure 
2, which shows the example of a first voice packet 31 
arriving on time in packet interval 11, while the next two 
voice packets 32 and 33 are delayed by a relatively large 
interval 13, and do not arrive until interval 14 during 
which data packet 34 is expected. 

As pointed out above, the decoder portion of the CODEC 
50 requires that data be supplied at a constant interval. 
Since there is no data present at any time during the 
packet intervals 12 and 13, and it is further delayed in 
interval 14, the decoder cannot reliably reproduce the 



original audio during this period. This condition may or 
may not be detectable by the human ear, depending on the 
length of the delay and the mechanism employed by the 
decoder to handle the idle time between packets. This 
problem is compounded by the fact that the late packets can 
be expected to eventually arrive, at which time the decoder 
has to decide what to do with them (since their time slots 
(intervals 12 and 13) have already passed). If this 
sequence of events occurs often enough, it can degrade 
voice performance to the point that the CODEC is not 
useable . 

One way to counter this problem, diagrammatic ally 
shown in Figure 4, is to delay the packets (under the 
control of an attendant microcontroller, shown at 55) 
through a buffer 60, such as a first-in, first-out data 
register (or FIFO), that is inserted into the receive or 
decoder end of the transport path through the CODEC 50. The 
challenge is to determine the proper amount of buffering 
(delay), that will allow the listener to comfortably 
discern the voice signals that the received packets 
represent. One approach is to establish a fixed delay at 
the beginning of a call, by buffering a given number of 
packets that are estimated to compensate for a reasonable 
amount of transport variance in the network. While this 
approach can work reasonably well, it has the shortcoming 



that a fixed delay buffer delay does not take into account 
actual network conditions. The amount of buffering needed 
to ensure proper operation at worst-case may be large 
enough to be. discernible by and unacceptable to some 
individuals. 

SUMMARY OF THE INVENTION 

The present invention solves the foregoing problem by 
automatically dynamically adjusting (increasing) the size 
of (or delay through) the buffer, based upon actual network 
conditions as they are encountered during a call. As will 
be described, the present invention operates on the premise 
that, if one or more packets are delayed in the network, 
their eventual arrival can be expected to be at a rate that 
is too fast to be processed in real-time by the decoder. 
Such eventual arrival may be exhibited as a string of 
immediately successive voice packets arriving a relatively 
large interval after arrival of a previous packet in its 
expected packet interval. 

As will be described the delay adjustment mechanism of 
the invention handles this problem in two parts. The first 
answers the question of what to do (namely what to provide 
over the decoder - listener path) during the delay period 
(when no packets are being received). Where the delay is 
reasonably brief and the amount of information in each 
packet is small, the last received packet is replayed in 



place of the missing packets. However, if delays are long, 
replaying the same packet over and over can begin sounding 
very unnatural. In this case, after the expiration of a 
user-programmed amount of time, the decoder may stop 
replaying the packet and begin playing silence. 

The second question is what to do with the late- 
arriving packets. In accordance with the present invention, 
late arriving packets are written into the delay buffer in 
the order that they arrive. They are then played out from 
the buffer at the nominal decoder data processing rate. 
Once some number of packets have been buffered in this 
manner, any further delay of the same duration or shorter 
than that currently provided by the buffer will not be 
heard by the user, since previously stored packets will be 
read out of the buffer in a periodic manner (and thereby 
played out to the listener) during the delay interval. 

However, should a longer network transport delay be 
encountered, an outage may be noticed, but only for the 
period of time exceeding the original outage. As a 
consequence, in the absence of an increase in network 
transport delay in excess of the delay interval, the 
decoder will remain some number of packets behind (missing 
or not received during the delay interval) for the duration 
of the call, introducing an overall end-to-end delay into 
the system. Should another delay of this same duration or 
less occur, the decoder will not be affected, as it will 
have a constant supply of packets from the input buffer. 




The amount of delay through the buffer will thereby 
be effectively equal to the largest delay encountered up to 
that point* In other words, delay is only inserted as it is 
required. It should be noted that once delay is encountered 
during a call, it is likely that another delay will follow. 
For this reason, any delay added by the buffering of 
packets is maintained for the duration of the call. 
Attempting to reduce the buffer size in real time would 
only cause more delays to be noticed by the user. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 diagrammatically illustrates respective 
CODECs installed at opposite ends of a digital transport 
channel of a digital voice network; 

Figure 2 is a set of timing diagrams for illustrating 
transport delay encountered in a voice packet network; 

Figure 3 diagrammatically illustrates data packets 
that are placed into a queue prior to be being transmitted 
over a digital communication channel; 

Figure 4 diagrammatically illustrates the use of a 
buffer at the decoder end of a digital transport path to 
compensate for transport delay through the network; and 

Figure 5 is a flow chart showing respective steps of 
the dynamically adjusted transport delay compensation 
mechanism of the present invention. 
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DETAILED DESCRIPTION 

Before describing in detail the dynamically adjusted 
transport delay compensation mechanism of the present 
invention, it should be observed that the invention resides 
primarily in what is effectively a prescribed arrangement 
of conventional communication circuits and . associated 
digital signal processing components and an attendant 
supervisory control program therefor, that controls the 
operations of such circuits and components. Consequently, 
the configuration of such circuits and components and the 
manner in which they are interfaced with other 
communication system equipment have, for the most part, 
been illustrated in the drawings by readily understandable 
block diagrams, which show only those specific details that 
are pertinent to the present invention, so as not to 
obscure the disclosure with details which will be readily 
apparent to those skilled in the art having the benefit of 
the description herein. Thus, the block diagram 
illustration and associated flow chart of the buffer delay 
control program to be described are primarily intended to 
show the major components of the system in a convenient 
functional grouping and processing sequence, whereby the 
present invention may be more readily understood. 
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As noted briefly above, the buffer delay control 
mechanism of the present invention is installed in and 
executed by the CODEC'S microcontroller, and is operative 
. to automatically and dynamically adjust the size of (namely 
packet delay through) the CODEC 1 s decoder-associated 
transport delay buffer, based upon actual network 
conditions encountered during the course of a call. Again, 
with reference to the timing signal diagram 30 of Figure 2, 
a successive string of delayed packets 32-35 arrive a delay 
interval B after initial packet 31, which is too fast to be 
processed in real-time by the CODEC. 

The buffer delay control mechanism of the invention 
not only controls the buffering of the late-arriving 
packets in the delay buffer, but also determines what is to 
be supplied to the decoder - listener path during the delay 
period between packets. Where the delay interval B is 
reasonably brief and the amount of information in each 
packet is small, the last received packet may be replayed 
in place of the missing packets. In the example shown in 
Figure 2, during the delay interval B of the (empty) voice 
packet intervals 12 and 13, the decoder portion of the 
CODEC may replay the same voice packet (voice packet 31). 
However, if the delay is relatively long, replaying the 
same packet plural times may sound unnatural. In such a 
case, after the expiration of a user-programmed amount of 
time, the decoder is instructed to stop replaying the 
packet and begin playing silence. 



The late-arriving or delayed packets are written into 
the delay buffer in the order that they arrive, and are 
thereafter read out of the buffer at the nominal decoder 
data processing rate. Once a prescribed number of packets 
have been buffered in . this manner, any further delay in 
. arrival of new packets that is the same as or shorter than 
the delay currently provided by the buffer will not be 
detected by the listener, since previously buffered packets 
will be successively read out of the buffer and played to 
the listener during the delay interval- Although an 
increase in network transport delay may produce a 
noticeable outage, it will exist only for the period of 
time exceeding the original delay. 

For the example shown in the timing diagram 30 of 
Figure 2, after the delay B, which terminates during packet 
interval 13, the first late arriving packet 32 will be 
routed to and stored in the delay buffer. During the next 
packet interval 14, this packet (packet 32) will be read 
out of the buffer and played out by the CODEC (decoder). 
The next two packets 33 and 34 also arrive during the 
fourth interval 14. Since one packet (i.e. packet 32) has 
already been read out during packet interval 14, no 
additional packet will be played until the next interval 
15. As a consequence, packets 33 and 34 will be routed to 
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and stored in the delay buffer. During packet interval 15, 
the next packet in the received and buffered sequence (here 
packet 33) is retrieved from the buffer and played by the 
decoder. In addition, the currently arriving packet (packet 
35) is routed into the buffer. 

Absent an increase in network transport delay in 
excess of B, the CODEC'S decoder will remain two packets 
behind for the duration of the call, introducing an overall 
end-to-end delay of B into the system. For the example 
shown in Figure 2, should another delay of two packets or 
less occurs, the amount of input delay to the decoder will 
not be affected, as it will have a constant supply of 
packets from the buffer. In addition, the amount of delay 
imparted by the buffer will be equal to the largest delay 
encountered up to that point. Thus, delay is only inserted 
as required. Once delay is encountered during a call, it is 
likely that another delay will follow. For this reason, any 
delay added by the buffering of packets is maintained for 
the duration of the call. Attempting to reduce the size of 
the buffer in real time would only cause more delays to be 
noticed by the user. 

Attention is now directed to the flow chart of Figure 
5, which shows the respective steps of the buffer delay 
control mechanism of the present invention that is executed 
by the transceiver microcontroller at the receive end of 
the channel to which the delay buffer and CODEC are 
coupled, as described above with reference to Figure 4. The 
buffer delay control mechanism shown in Figure 5 employs 



two user-programmable parameters: 1- MIN_BUF and 2- 
MAX_BUF. The parameter MIN_BUF is defined to be the number 
of frames/packets that must be present in the buffer before 
the decoder portion of the CODEC actually begins playing 
out frames/packets. This parameter is usually set to a 
small value (typically a value of '1'), in order to 
compensate for small amounts of variance in frame/packet 
arrival time. 

The parameter MAX_BUF is the maximum number of 
frames/packets that can be buffered before frames/packets 
are discarded. This parameter serves to prevent extremely 
long delays from being inserted into the data path. The 
buffer delay control mechanism of the invention also 
employs a frame/packet softcounter, termed l BUF_COUNT l , 
which indicates how many frames are currently stored in the 
delay buffer FIFO. Another parameter, termed 1 BUF__FLAG 1 is 
used to determine when a minimum number of frames has been 
received to start playback. 

Referring to Figure 5 , in response to a newly incoming 
voice call at START VOICE step 501, the BUF_COUNT and 
BUF_FLAG parameters are both cleared or reset to zero in 
step 503. Next, in query step 505, the routine determines 
whether an incoming voice packet is detected within the 
packet interval of interest (such as in a respective 
reception period of one of the packet intervals 11-15 of 
Figure 2. If a voice packet is not detected within the 
expected packet interval reception period of the packet 
interval of interest, the answer to step 505 is NO, and the 
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routine transitions to query step 515 to determine whether 
the failure to detect a packet is due to the fact that the 
call has terminated. At the beginning of a call, any such 
failure is ostensibly (although not necessarily) associated 
5 with or due to channel transport delay, rather than 

termination of a call. 

If a packet is detected within the packet interval, 
the answer to step 505 is YES, the routine transitions to 
query step 507 to determine whether the buffer count value 

105: BUF_C0UNT is less than the capacity of the delay buffer, 

O 

□ namely the parameter MAX__BUF. Since, at the start of a 

fU 

g! frame, the value of BUF_COUNT has been reset to zero, the 

O 

q answer to step 507 is YES, and the routine transitions to 

^ step 50 9. In step 50 9, the routine increments the buffer 

lilt counter BUF_C0UNT by f l T (currently from its initially 

cleared value of 1 0 1 to a value of 'l f ), and transitions to 
step 511. If the answer to step 507 is NO, the routine 
transitions to step 510, which discards the oldest data 
packet from the delay buffer, to make room for the next 
20 incoming packet, and then transitions to step 511. As there 

are currently no packets stored in the buffer, the answer 
to step 50 7 is YES, as noted above. 

In step 511, the (most recently) received packet/frame 
is stored in the delay buffer, and the routine transitions 
25 to query step 519, which determines whether the buffer flag 

parameter BUF_FLAG is set to a '1' . Since, at the beginning 
of the call, this parameter was reset to zero in step 503, 
the answer to step 519 is NO, so that the routine 
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transitions to query step 521. In query step 521, a 
determination is made as to whether the count value of the 
buffer counter BUF_COUNT (which was incremented in step 50 9 
to a value of 'l 1 from its originally cleared value of 
zero) exceeds the user set parameter MIN_BUF. As pointed 
out above, the parameter MIN_BUF is used to compensate for 
small amounts of variance in frame/packet arrival time, and 
corresponds to a small number of frames/packets (usually 
'I 1 ) that must be present in the buffer, before packets are 
read out of the buffer for application to the decoder. 
Since the current value ( 1 1 r ) of the buffer counter 
BUF_C0UNT does not exceed MIN_BUF = 1 1 1 , the answer to 
query step 521 is NO, and the routine loops back to query 
step 505, and the sequence described above is again 
executed. 

When the next received packet is stored in the delay 
buffer, the value of the buffer counter BUF_C0UNT will have 
been incremented from 1 1 1 to ! 2 r in step 509, so that 
during the next loop through query step 521, the newly 
incremented value ( '2' ) of the buffer counter BUF_COUNT 
will exceed MIN_BUF = 1 1 1 , whereby the answer to query step 
521 will be YES, and the routine transitions to step 523, 
which sets the previously cleared parameter BUS_FLAG to a 
' 1 ! . The routine then transitions to step 525, which causes 
the oldest packet/frame stored in the delay buffer to be 
played out to the decoder. 
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Next in step 527, the value of the buffer counter 
BUF_COUNT is decremented by '1'- indicating a decrease in 
the contents of the delay buffer - and the routine loops 
back to step 505. Once the value of BUF_FLAG has been set 
5 (in step 523) to a 'l f , the answer to query step 519 is 

YES, and the routine transitions from step 519 to query 
step 529, in order to determine whether the value of the 
value of the buffer counter BUF_COUNT has been decremented 
down to 1 0 1 - indicating that there are no packets 
10^ currently stored in the delay buffer. 

□ As pointed out above, if a long delay occurs on the 

□ 

Til network, the delay buffer will become emptied of packets, 

m 

.□ causing the answer to step 529 to be YES, and the routine 

4: transitions from step 529 to step 531. In step 531, the 

lfk decoder will either replay the last frame/packet or will 

Hi 

pi play silence for the packet interval of interest, and then 

U 

n loop back to step 505. As described above, if the network 

r delay is unusually long, replaying the same packet over and 

over can begin sounding very unnatural. In this case, step 
20 531 may include a subroutine, which is effective to 

terminate replaying the same packet after the expiration of 
a user-programmed amount of time. 

Eventually, as the late packets that gave rise to the 
delay (such as that shown at J3 in the timing diagram 3 0 of 
25 Figure 2) start arriving, the routine will sequentially 

transition from a YES answer to query step 503 through 
steps 505-511 for each of theses successively received 
packets, thereby repeatedly incrementing the buffer counter 
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BUF_COUNT in step 50 9 and storing the packets in step 511. 
This will store packets in the buffer up to a level that is 
equal to the number of repeat and silence frames that had 
been previously played out in step 531, and will 
effectively set the end-to-end delay through the buffer to 
the maximum delay thus far encountered during the call. 
Thus, the routine of Figure 5 is effective to increase the 
amount of delay through the buffer, as necessary to 
accommodate increases in network delay, by the successive 
incrementing of the buffer counter BUF_C0UNT parameter in 
step 50 9 and the storage of an associated packet in step 
511, as it is required. 

As described previously, once delay is encountered 
during a call, it is likely that another delay will follow. 
As the amount of delay increases, the number of eventually 
arriving packets associated with the increased delay will 
cause steps 505-511 to further increment the buffer counter 
BUF___COUNT in step 50 9 and store the increased number of 
packets in step 511. This will again bring the number of 
packets stored in the buffer up to a level that is 
necessary to set the end-to-end delay through the buffer to 
the maximum delay encountered during the call. 



Namely, the. total amount of delay through' the buffer 
will always equal the largest delay encountered up to that 
point in the call, as delay is only inserted as required. 
Thus, any delay added by the buffering of additional 
packets in steps 50 9 and 511 will be maintained for the 
duration of the call. As pointed out earlier, attempting to 
reduce the size of the buffer in real time would only cause 
more delays to be noticed by the user. 

Eventually, when the call ends, the lack of incoming 
frames/packets to query step 505 will be due to a 
termination of voice signalling traffic, rather than 
network delay. In this event, the answer to query step 515 
(to which the routine transitions from the NO answer to 
step 505) will be YES, and the routine will branch to call 
termination step 516, ending the call. When a new call is 
received, the BUF_COUNT and BUFJFLAG parameters are both 
cleared to zero in step 503, and the routine is executed 
for the new call in the manner described above. 

As will be appreciated from the foregoing description, 
the delay buffer control mechanism of the present invention 
is operative to automatically dynamically adjust (increase) 
buffer delay, as necessary, based upon actual network 
conditions as they are encountered in the course of .a call. 
As described above, the inventive buffer delay control 
mechanism either replays the last received packet or, if 
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the delay is inordinately long, plays silence over the 
decoder - listener path during a period of network 
transport delay. Late-arriving packets are written into the 
delay buffer in the order that they are received, and are 
played out of . the buffer at the nominal decoder data 
processing rate. 

Once some number of packets have been buffered in this 
manner, any further delay of the same duration or shorter 
than that currently provided by the buffer will not be 
heard by the user, since previously stored packets will be 
read out of the buffer and periodically played to the 
listener during the delay interval. In the absence of an 
increase in network transport delay in excess of the delay 
interval, the decoder will remain some number of packets 
behind for the duration of the call, introducing an overall 
end-to-end delay into the system. Should another delay of 
this same duration or less occur, the decoder will not be 
affected, as it will have a constant supply of packets from 
the input buffer. Thus, the amount of delay will be 
effectively be equal to the largest delay encountered up to 
that point. 
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While I have shown and described an embodiment in 
accordance with the present invention, it is to be 
understood that the same is not limited thereto but is 
susceptible to numerous changes and modifications as are 
known to a person skilled in the art, and I therefore do 
not wish to be limited to the details shown and described 
herein, but intend to cover all such changes and 
modifications as are obvious to one of ordinary skill in 
the art. 



